KW second pass at Taves data

This is Kara’s second pass at looking at the Taves data, looking only at participant’s endorsements of whether or not they had had certain experiences (not their assessment of what they meant, etc.).

Notes: per our conversation with Nikki, we are dropping one question (#53), which was a repeated question in all sites except for China.

Overall counts

First, let’s look at the overall counts of “yes” responses, by site:

Joining, by = "taves_subj"

And now let’s compare each country to the country with the next-most “yes” responses: contrast #1 will be US vs. Thailand, #2 will be Thailand vs. China, etc.:

Call:
lm(formula = total ~ taves_ctry, data = d_counts)

Residuals:
    Min      1Q  Median      3Q     Max 
-28.414  -7.391  -0.463   7.586  40.679 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept)  21.3959     0.5157  41.488  < 2e-16 ***
taves_ctry1   1.1988     0.8196   1.463 0.144133    
taves_ctry2   1.4471     0.4895   2.956 0.003252 ** 
taves_ctry3   1.0723     0.3078   3.483 0.000536 ***
taves_ctry4   1.7546     0.2647   6.629 8.29e-11 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 11.88 on 533 degrees of freedom
Multiple R-squared:  0.1099,    Adjusted R-squared:  0.1032 
F-statistic: 16.45 on 4 and 533 DF,  p-value: 1.021e-12

This approach suggests that all of these comparisons are significant, except for the US vs. Thailand (p = 0.144).

Polychoric factor analysis

Factor loadings

Matrix was not positive definite, smoothing was done

Joining, by = "question"
Joining, by = "question"

Here’s a plot of an exploratory factor analysis using polychoric correlations (since we’re working with yes/no responses), an oblique rotation (“oblimin,” which allows factors to correlate with each other), and a “weighted least squares” factoring method (because other methods throw convergence errors).

It’s very important to note that this might not be the “right” number of factors to extract here - different guidelines made different suggestions, ranging from 2 or 3 factors up to 17. 8 factors seemed like something of a middle ground, and seemed to produce sensible results.

Factor scores

Matrix was not positive definite, smoothing was doneJoining, by = "taves_subj"

Here’s a plot of factor scores, by country, using the factor analysis solution illustrated above. The light, colorful dots are individual participants; the block dots are means by country and 95% bootstrapped confidence intervals. For each factor I printed out the text of the item that loaded most strongly on that factor - see the previous graph for more about the relationships between items and factors.

Joining, by = "taves_subj"
Joining, by = "question"

Averages (0-1)

Here’s a plot of averages (0-1), by country, using the factor analysis solution illustrated above. The light, colorful dots are individual participants; the block dots are means by country and 95% bootstrapped confidence intervals. For each factor I printed out the text of the item that loaded most strongly on that factor - see the previous graph (2 graphs back) for more about the relationships between items and factors.

Raw data

The following plots show raw data: how many participants said yes to each question, broken down by country. I’ve split up the questions into which factor they loaded most strongly on (see top left corner of each of the following plots). The dotted line marks the 50% point (50% of participants in that country said “yes” to this question). Note that this does not take into account missing data - i.e., the proportion of “no” responses is not necessarily equal to 1 - the proportion of “yes” responses.

Using alpha for a discrete variable is not advised.

Using alpha for a discrete variable is not advised.

Using alpha for a discrete variable is not advised.

Using alpha for a discrete variable is not advised.

Using alpha for a discrete variable is not advised.

Using alpha for a discrete variable is not advised.

Using alpha for a discrete variable is not advised.

Using alpha for a discrete variable is not advised.